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ABSTRACT 

We present results on the Fundamental Plane of early-type galaxies in the cluster RDCS J0848+4453 at z = 1 .27. 
Internal velocity dispersions of three ^-selected early-type galaxies are determined from deep Keck spectra, using 
absorption lines in the rest-frame wavelength range 3400 A - 4000 A. Structural parameters are determined from 
Hubble Space Telescope NICMOS images. The galaxies show substantial offsets from the Fundamental Plane 
of the nearby Coma cluster, as expected from passive evolution of their stellar populations. The offsets from 
the Fundamental Plane can be expressed as offsets in mass-to-light (M/L) ratio. The M/L ratios of the two 
most massive galaxies are consistent with an extrapolation of results obtained for clusters at 0.02 < z < 0.83. 
The evolution of early-type galaxies with masses > 1O U M0 is well described by InM/Ls oc (— 1.06±0.09)z, 
corresponding to passive evolution of — 1 .50 ±0.13 magnitudes at z = 1.3. Ignoring selection effects, the best 
fitting stellar formation redshift is z* = 2.6^1 for an {l m = 0.3, fl\ = 0.7 cosmology and a Salpeter IMF, 
corresponding to a luminosity weighted age at the epoch of observation of ~ 2Gyr. The M/L ratios of these 
two galaxies are also in excellent agreement with predictions from models that include selection effects caused 
by morphological evolution ("progenitor bias"). The third galaxy is a factor ~ 10 less massive than the other two, 
shows strong Balmer absorption lines in its spectrum, and is offset from the Coma Fundamental Plane by 2.9 mag 
in rest-frame B. Larger samples are required to determine whether such young early-type galaxies are common 
in high redshift clusters. Despite their large range in M/L ratios, all three galaxies fall in the "Extremely Red 
Object" (ERO) class with I — H >3 and R — K>5, and our results show that it is hazardous to use simple models 
for converting luminosity to mass for these objects. The work presented here, and previous mass measurements 
at lower redshift, can be considered first steps to empirically disentangle luminosity and mass evolution at the 
high mass end of the galaxy population, lifting an important degeneracy in the interpretation of evolution of the 
luminosity function. 

Subject headings: galaxies: clusters: general — galaxies: evolution — galaxies: structure of — galaxies: 
kinematics and dynamics — galaxies: elliptical and lenticular, cD 



1. INTRODUCTION 

One of the defining characteristics of galaxy formation mod- 
\ els is the evolution of the galaxy mass function with time. In 
traditional "monolithic collapse" models, galaxies formed at 
early times from the collapse of proto-galactic gas clouds, and 
the mass function evolved very little after z ~ 3 (e.g., Eggen, 
Lynden-Bell, & Sandage 1962; Searle, Sargent, & Bagnuolo 
1973; Jimenez et al. 1999). In contrast, hierarchical models for 
galaxy formation in Cold Dark Matter cosmologies postulate 
that galaxies continuously form in mergers, implying strong 
evolution in the mass function over the redshift range < z < 2 
(e.g., White & Frenk 1991; Kauffmann & Chariot 1998; Cole 
et al. 2000; Somerville, Primack, & Faber 2001). 

Although these models are very different, determining which 
is closer to reality has proven to be quite difficult. An important 
constraint on the evolution of the mass function is the evolution 
of the /f-band luminosity function, under the assumption that 
T^-band light is a good tracer of stellar mass to z ^ 1 (Kauff- 
mann & Chariot 1998). Observationally, this evolution is diffi- 
cult to measure as deep ^-selected redshift surveys over large 



fields are required. Past and ongoing surveys seem to indicate 
some evolution in the number density, although the amount is 
still uncertain (e.g., Cowie et al. 1996; Kauffmann & Chariot 
1998; Stern et al. 2001; Drory et al. 2001; Cimatti et al. 2002). 
Other studies focus exclusively on the reddest galaxies, usually 
defined as having I — H>3orR — K>5 (e.g., Daddi, Cimatti, 
& Renzini 2000; McCarthy et al. 2001; Roche et al. 2002). 
A large fraction of these "Extremely Red Objects" (EROs) are 
thought to be passively evolving massive galaxies at 1 <; z < 2, 
whose number density may constrain the evolution of the mass 
function without the need for full redshift information. 

One of the main uncertainties in the interpretation is the 
model-dependent conversion of luminosity to stellar mass. The 
observed evolution of the luminosity function is caused by a 
combination of evolution of the underlying mass function and 
the evolution of stellar populations. At z ~ 1, the /f-band sam- 
ples the rest-frame /-band, and mass-to-light {M/L) ratios of 
galaxies are quite uncertain even if they are "pre-selected" to 
be passively evolving through the use of broad-band colors. As 
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an example, the Worthey (1994) models 4 predict a variation 
of a factor 2.4 in the M/Lj ratio for luminosity weighted ages 
ranging from 1-5 Gyr and [Fe/H] ranging from —0.225 to 
+0.5. At the bright end of the luminosity function this uncer- 
tainty in M/L ratio contributes directly to the uncertainty in the 
number density. 

For a correct interpretation of the luminosity function it is 
therefore essential to measure masses and mass-to-light ratios 
directly, so that luminosities can be converted to masses in a 
model-independent way. Total masses of galaxies are noto- 
riously difficult to measure, but scaling relations such as the 
Tully-Fisher relation for spiral galaxies (Tully & Fisher 1977) 
and the Fundamental Plane (FP) for early-type galaxies (Djor- 
govski & Davis 1987; Dressier et al. 1987) can be used to con- 
strain the evolution of the M/L ratio relative to local samples 
(see Franx 1993). 

In star forming disks aging of the stellar population is com- 
pensated by the formation of new stars, and models predict 
only modest or even negative evolution in the M/L ratio with 
time (e.g., Pozzetti, Bruzual A., & Zamorani 1996; Ferreras 
& Silk 2001). The observed evolution of the Tully-Fisher rela- 
tion lends support to these models, ruling out strong (1-2 mag) 
evolution over the redshift range < z < 1.3, at least for the 
most massive galaxies (Vogtetal. 1996, 1997; van Dokkum & 
Stanford 2001; Ziegler et al. 2002). 

By contrast, the M/L ratios of early-type galaxies (and the 
bulges of spiral galaxies) are expected to increase over time, 
as the demise of massive stars causes their stellar populations 
to fade (Tinsley & Gunn 1976). The evolution of M/L ra- 
tios of early-type galaxies has been measured in rich clusters at 
0.02 < z < 0.83 (e.g., van Dokkum & Franx 1996; Kelson et al. 
1997; Bender et al. 1998; van Dokkum et al. 1998), and in the 
general field to z ~ 0.7 (Treu et al. 1999; van Dokkum et al. 
2001a; Treu et al. 2002), using the Fundamental Plane relation. 
The cluster data show a gradual increase of the mean M/L B ra- 
tio by a factor ~ 3 since z — 0.83 (for Q m = 0.3, f^A = 0.7). The 
results for the general field are still somewhat uncertain, but in- 
dicate that field early-type galaxies have similar M/L ratios as 
those in clusters, at least out to z « 0.6. 

In this paper, we present results on the Fundamental Plane 
and M/L ratios in the cluster RDCS J0848+4453 at z = 1.27 
(Stanford et al. 1997), probably the highest redshift acces- 
sible for velocity dispersion measurements with the current 
generation of telescopes. Although it is hazardous to extrap- 
olate the results presented here to the general population of 
distant red galaxies, studies of the Tully-Fisher relation and 
the FP at z ^ 1 can be regarded as tentative first steps toward 
an empirical determination of the mass function at high red- 
shift. We assume 0,„ = 0.3 and f^A = 0.7 throughout. We used 
H = 50kms~' Mpc~' where needed, but note that our results 
are not dependent on the value of the Hubble constant. 

2. SPECTROSCOPY 

2.1. Sample Selection and Observations 

The sample selection was based on an extensive BRIzJK s sur- 
vey of a 28 arcmin 2 field in Lynx (Eisenhardt et al., in prepera- 
tion). Keck spectroscopy and Chandra imaging (Stanford et al. 
2001) has revealed that the Lynx field contains three distant X- 
ray clusters: RDCS J0848+4452 at z = 0.57 (Holden et al. 
2001), RDCS J0848+4456 at z = 1 .26 (Rosati et al. 1999), and 

4 www.astro.wsu.edu/worthey/dial/dial_a_model.html 



RDCS J0848+4453 at z= 1.27 (Stanford et al. 1997). Galaxies 
in the Lynx field were selected on the basis of their K s magni- 
tude. Three multislit masks were designed. The primary sample 
consists of seven K s < 19 galaxies with spectroscopic redshifts 
1.25 < z < 1.29; these galaxies were repeated in each mask. 
Remaining space in the three masks was filled with K s < 20 
galaxies without spectroscopic redshift. 

The Lynx field was observed on 2001 January 20-21 with 
the Low Resolution Imaging Spectrograph (LRIS; Oke et al. 
1995) on the Keck II Telescope. The D680 dichroic was used, 
in conjunction with the 600 lines mm -1 grating blazed at l^m 
in the red and the 300 lines mm~ 1 grism blazed at 5000 A in the 
blue. The 1"2 wide slits give a resolution of 5.7 A FWHM as 
measured from the width of atmospheric emission lines, which 
corresponds to <Ti nstr « 80kms _1 at 9000 A. Conditions were 
photometric, and the seeing was « 0."9. In order to facilitate 
sky subtraction the galaxies were moved along the slit between 
successive exposures, with offsets — 1."5, — 4"5, +1."5, +4."5 
with respect to the initial position. The integration time for each 
exposure was 1800 s. Each of the three masks was observed for 
a total of 14.4 ks, split in two sequences of the four dither po- 
sitions. The total integration time for galaxies in the primary 
sample is 43.2ks, or twelve hours. 

Initial results from our deep spectroscopy were presented in 
van Dokkum & Stanford (2001). The present paper discusses 
the three galaxies in the primary sample that fall within the area 
of our deep Hubble Space Telescope (HST) WFPC2 and NIC- 
MOS imaging of RDCS J0848+4453 at z = 1.27. They are 
the brightest, second brightest, and fourth brightest early-type 
galaxies in our /f-selected sample of cluster galaxies observed 
with HST (van Dokkum et al. 2001b). 

2.2. Reduction 

Each set of four dithered 1800 s exposures was reduced sep- 
arately. Each slitlet was treated as a separate, long slit spec- 
trum. Bias was subtracted by fitting low order polynomials to 
the overscan regions. The red CCD was read out using two am- 
plifiers; the overscan region for each amplifier was fitted sepa- 
rately. No systematic variations are present in the residuals of 
bias frames or the overscan regions of science images. 

The most critical step in the data reduction is the removal 
of the fringe pattern in the red exposures. Internal flatfields 
were taken every ~ 90 minutes, such that there was a flatfield 
within one hour of each science exposure. For each slit, the 
flatfield was divided by the average response in the wavelength 
direction. The response was obtained by averaging the flatfield 
in the spatial direction and fitting a fifth order polynomial in 
the wavelength direction. Flatfielding reduced the peak-to-peak 
variation in the fringe pattern from « 7 % to « 2 %. A map of 
the residual fringe pattern was created from the four dithered 
exposures in the following way. First, sky lines were fitted by 
a third order polynomial, masking the galaxy spectrum (and 
any other objects) in the fit. Next, the median of the four sky 
subtracted spectra was computed, disregarding pixels at the po- 
sitions of object spectra. Finally, this median residual map was 
fitted by a low order polynomial in the wavelength direction to 
remove faint unmasked objects and any residuals from galaxy 
spectra. The fringe map was subtracted from each of the four 
exposures. Residual peak-to-peak variations are < 0.5 %, and 
the noise in the final combined spectra is dominated by Poisson 
fluctuations. 
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Cosmic ray removal is not straightforward, despite the large 
number of independent exposures. As a result of our dither- 
ing procedure and flexure in the spectrograph the positions of 
galaxy spectra as well as those of sky lines change from one ex- 
posure to the next. Therefore, the sky lines and object spectra 
were modeled and subtracted before identifying cosmic rays in 
the residual images. Sky lines were modeled by fitting low or- 
der polynomials. The object spectrum was modeled by taking 
the median of the four object spectra extracted from the individ- 
ual dithered exposures, and smoothing with a 3 x 3 boxcar fil- 
ter. The model sky and the model galaxy (shifted appropriately 
for each dithered exposure) were summed to create 2D model 
spectra, which were subtracted from each exposure. Cosmic 
rays were identified by comparing the flux in the residual im- 
ages to the expected noise calculated from the 2D model. Pixels 
affected by cosmic rays were replaced by the values of corre- 
sponding pixels in the model. 

Sky lines were subtracted from the cosmic ray cleaned expo- 
sures by fitting a third order polynomial in the spatial direction, 
masking the galaxy and any other objects in the slit. Subtracting 
the sky lines before wavelength calibration and rectification has 
the disadvantage that the lines are still slightly tilted. However, 
the advantage of this procedure is that aliasing due to rectifi- 
cation of sharp, bright lines is avoided; tests showed that such 
aliasing effects can be avoided entirely by reversing the usual 
reduction procedure. 

A separate wavelength solution was obtained for each of the 
four galaxy spectra. Arc lamp exposures were taken at regu- 
lar intervals during the night. A fit to the positions of bright 
lines in the nearest arc exposure provided the initial solution. 
The observed locations of the [Ol] 5577.34 A sky line in the 
blue and the OH 7-3 PI 8885.85 A sky line in the red were 
used to correct the zeropoint for each spectrum; these correc- 
tions were typically ~ 3 A. The sky subtracted 2D spectra were 
transformed to a common log A scale. 

The galaxy spectra are too faint in individual 1800 s expo- 
sures for a reliable S-distortion correction. Therefore, the four 
spectra were first combined into a single 2D spectrum, using 
linear weighting by the signal-to-noise (S/N) ratio. The S- 
distortion was removed by binning the spectrum in 100 A wide 
bins and fitting a low order polynomial. Atmospheric absorp- 
tion features were removed using the spectrum of a bright blue 
star that was included in each of the masks. A long slit spec- 
trum of the star G191B2B (Massey & Gronwall 1990) taken 
with the same instrumental setup provided an approximate flux 
calibration. Finally, the six 7200 s spectra were combined into 
a single 43.2 ks spectrum, using optimal weighting. 

2.3. Spectral Properties 

Spectra of the three galaxies that are covered by our HST 
imaging are shown in Fig. 1, smoothed with a boxcar filter of 
width 10 A in the observed frame to enhance broad absorption 
features. The ID spectra were extracted by summing the five 
central rows (l."l) in the 2D spectra. No weighting was ap- 
plied, to facilitate aperture corrections (see § 2.4). For each 
galaxy the S/N per A at A rest = 3700 A (calculated from the un- 
smoothed data) is listed in Table 1 . 

The most prominent absorption features are Ca II H and K, 
Mg I and Mg II, and the ~ 2600 A break. Although evolved 
stellar populations have many absorption features between ~ 

5 Obtained from the BAse Solaire Sol 2000 (http://mesola.obspm.fr/form_spectre.: 



3400 A and ~ 3900 A, line indices have been defined for only a 
handful (see Ponder et al. 1998). The strongest are two intrin- 
sically broad lines: a blend at 3580 A (Davidge & Clark 1994) 
and a blend of Fe I and Mg I at 3840 A (Pickles 1985). 

Interestingly, galaxies J0848-1 and J0848-2 show 
[O II] 3727 A emission, with rest-frame equivalent width 
— 17 ±2 A and — 13 ±2A respectively. Furthermore, all three 
galaxies show some evidence for enhanced H<5 absorption, 
although measurements in this spectral region are severely af- 
fected by sky line residuals. In galaxy J0848-3 the higher order 
Balmer lines He, H6, and H7 are clearly enhanced as well. 
He and H7 are blended with CaH and Fel + Mgl at 3840 A 
respectively, but H6 is not contaminated by any strong metal 
lines. The rest-frame equivalent width of H6 is 4.5 ± 0.8 A, 
making J0848-3 the highest redshift "E+A" galaxy (Dressier 
& Gunn 1983) currently known. 

No U V upturn is evident at A <J 2500 A, consistent with the 
idea that hot horizontal branch stars do not contribute signifi- 
cantly to the mid-UV flux in stellar population with ages less 
than ~ 5 Gyr (e.g., Dorman, O'Connell, & Rood 1995; Brown 
et al. 2000). A full analysis of the mid-UV spectral features 
is beyond the scope of the present paper; we note here that 
the mid-UV spectra are very similar to those of nearby galax- 
ies having intermediate age populations, such as NGC3610 or 
M32 (see Lotz, Ferguson, & Bohlin 2000). 

2.4. Velocity Dispersions 

Kinematics of nearby early-type galaxies are usually deter- 
mined from the spectral region containing the strong Mg/, line 
at5172A (e.g., Davies et al. 1987; Lucey et al. 1991; J0r- 
gensen, Franx, & Kjaergaard 1995b; Mehlert et al. 2000). Stud- 
ies of early-type galaxies at z ;> 0.5 have used bluer spectral 

regions near the G-band at 4300 A (e.g., van Dokkum & Franx 
1996; Kelson et al. 2000a; Koopmans & Treu 2002). Beyond 
z~ 1.1 it seems attractive to use the strong Ca II H and K lines 
for measuring velocity dispersions (see, e.g., Kobulnicky & 
Gebhardt 2000). However, because these lines are intrinsically 
broad (er w 5 A) they are not very sensitive indicators of velocity 
dispersion. Additional problems are template mismatch caused 
by errors in the continuum fitting across the 4000 A break and 
the fact that the Ca II H line at 3968 A is blended with He at 
3969 A. Empirically, the Ca II H and K lines appear to overesti- 
mate the velocity dispersion (Kormendy & Illingworth 1982). 

In the present study we explore the use of near-UV lines 
blueward of the Ca II H and K lines for measuring velocity dis- 
persions of high redshift galaxies. Central velocity dispersions 
were determined from a fit to a convolved template star spec- 
trum in real space, following the procedures outlined in van 
Dokkum & Franx (1996) and Kelson et al. (2000a). The wave- 
length region is 3400 - 4000 A in the rest-frame, with regions 
around [O II] 3727 A and the Balmer lines masked. The spectra 
were weighted by the S/N ratio, as determined from sky spectra. 

The solar spectrum 5 was used in the fits, because it spans the 
entire rest-frame wavelength range of our LRIS-R observations 
at high S/N ratio, and its spectral type is expected to be appro- 
priate for the integrated light of intermediate age stellar popula- 
tions. The validity of this approach is tested in Sect. 2.5 on two 
nearby galaxies. For each galaxy the wavelength-dependent in- 
strumental resolution was determined from sky lines, and the 
solar spectrum was smoothed and rebinned to match the reso- 
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Fig. 1. — Keck spectra of three early-type galaxies in the z = 1.27 cluster RDCS J0848+4453, smoothed by a boxcar filter of width 10 A in the 
observed frame. Spectra from the blue arm and the red arm of LRIS are shown separately. The exposure time is 43.2 ks. Galaxies J0848-1 and 
J0848-2 show [O II] emission; galaxy 0848-3 has strong Balmer absorption lines. 



lution of the galaxy spectra. 

Fits and their residuals are shown in Fig. 2, and the result- 
ing velocity dispersions are listed in Table 1 . For consistency 
with earlier work the dispersions in our 0."9 x l'.'l rectangular 
apertures were corrected to a circular aperture of 3. "4 diameter 
at the distance of Coma, following the procedure of J0rgensen 
et al. (1995b). The errors in Table 1 do not include a system- 
atic uncertainty of <~ 5 %, determined from varying the contin- 
uum filtering, the wavelength range, and the weighting scheme. 
Limiting the fitting range to 3400 — 3900 A had a negligible 
effect on the dispersions and their uncertainties, and no stable 
solutions were found when only the region 3800 — 4000 A was 
used in the fit. These results suggest that the Ca II H and K lines 
have little weight in the fit, as expected from their large intrinsic 
width. 



We were unable to measure stable dispersions when we lim- 
ited the wavelength range to 3400 — 3700 A, or split the data in 
two independent datasets with effective exposure time 21.6ks. 
These tests indicate that our observations just reach the required 
S/N for velocity dispersion measurements at this redshift. 

TABLE 1 
Velocity Dispersions 



Galaxy 


S/N 


z 


a (km s ') 


J0848-1 


14 


1.2751 


237 ± 34 


J0848-2 


15 


1.2770 


308 ±41 


J0848-3 


17 


1.2774 


174 ±29 
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Fig. 2.— The spectral region 3400 - 4000 A at full resolution, i.e., 
without any smoothing. The solar spectrum is shown in red, smoothed 
to the velocity dispersion of the galaxies, and offset for clarity. Below 
each spectrum the residuals from the fit are shown. Note the higher 
order Balmer lines in the residuals of J0848-3. 



2.5. Tests on Two Nearby Galaxies 

Moderate resolution near-UV spectra were obtained for two 
nearby galaxies, NGC 3610 and NGC 5018, in order to test 
whether velocity dispersions obtained from near-UV lines are 
unbiased with respect to determinations from redder spectral 
regions. The galaxies were selected because they are believed 
to have comparitively young luminosity weighted ages; galax- 
ies at z = 1 -27 are at most ~ 5 Gyr old, and their stellar popu- 
lations may resemble those of young early-type galaxies in the 
local Universe (see Sect. 2.3). 



NGC 3610 is classified as E5, has significant morpholog- 
ical fine structure indicating a recent merger, and is thought 
to have a centrally concentrated intermediate-age stellar pop- 
ulation (Silva & Bothun 1998, and references therein). The 
galaxy also has a dynamically cold disk (Rix & White 1992). 
NGC 5018 is an elliptical galaxy with shells, and is also 
considered to be a recent merger remnant (e.g., Fort et al. 
1986). Modelling of line indices indicates the presence of a 
~ 3 Gyr old stellar population dominating the light at ~ 4000 A 
(Leonardi & Worthey 2000). 

The galaxies were observed 2001 June 19, with the LRIS 
Double Spectrograph on the Keck I Telescope, using a 1 "0 slit 
and the D460 dichroic. The two arms of LRIS allow simul- 
taneous measurement of velocity dispersions in the red and the 
near-UV, sampling approximately the same spatial region of the 
galaxies. The blue arm used the ^OOlinesmm^ 1 grism blazed 
at 3400 A, giving a wavelength range of 3000 A - 3800 A. The 
red arm used the 900 lines mm -1 grating blazed at 5500 A; 
the grating angle that was used gives a wavelength range of 
4700 - 5950 A. The instrumental resolution as measured from 
night sky lines cri nstl - « 65 kms _I at 3500 A and «s 70kms~ 1 at 
5200 A. Exposure times were 1800 s for NGC 3610 and 1800 s 
for NGC 5018. The observations were done through cirrus 
and occasional clouds. Spectra of template stars HD 102494 
(G9IV), HD 132737 (K0III), and HD 2 10220 (G6III) were ob- 
tained in twilight, using the same instrumental setup. 

The reduction followed standard procedures for long slit 
spectroscopic data. Bias levels were determined from the over- 
scan regions on the CCD. Internal flat fields were used to cor- 
rect for the pixel-to-pixel variation of the CCD response. Cos- 
mic rays were removed using the L. A. COSMIC task (van 
Dokkum 2001). Arc lamp lines were used for wavelength cali- 
bration, with zeropoint offsets determined from sky lines in the 
object spectra. Sky spectra were determined from the edges 
of the slit, and subtracted. Normalized near-UV spectra of 
NGC 3610 and NGC 5018 are shown in Fig. 3. The ID spec- 
tra were extracted by summing ten rows, corresponding to 2"2. 
The S/N ratio per A is 55 for NGC 3610 and 23 for NGC 5018. 
The region 3465 A - 3495 A is not shown because the galaxy 
spectra are severely affected by the presence of an undispersed 
slit image in that region, caused by insufficient baffling of the 
blue grism. 

Velocity dispersions were determined from a direct fit of the 
template stars to the galaxy spectra, as discussed in Sect. 2.4. 
In addition to the three template stars observed with LRIS-B 
the solar spectrum was used in the fits. The solar spectrum was 
smoothed and rebinned to match the resolution of the galaxy 
spectra. The results are listed in Table 2. 

There is evidence that the red spectral region gives slightly 
higher velocity dispersions (by ~ 5 %) than the near-UV region. 
If the effect is real, it may indicate a bias in the measurement 
technique, or reflect the presence of a dynamically cold com- 
ponent of young stars in these two galaxies. The small differ- 
ence may also be caused by differential atmospheric refraction 
(causing misalignment of the slit and the galaxy center in the 
near-UV), since both galaxies were observed at high airmass. 
The sign of the difference is consistent with this explanation, 
but the effect is difficult to quantify because early-type galaxies 
often show complex structure in their central velocity disper- 
sion profiles (e.g., van der Marel et al. 1994). 
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Fig. 3.— Near-UV spectra of NGC 3610 (top) and NGC 5018 (bot- 
tom), at a resolution <7i„str ~ 65kms _1 . Both spectra were normal- 
ized by fitting a low order polynomial; for clarity the spectrum of 
NGC 5018 was offset by —0.6. Many moderately strong absorption 
lines are present in this spectral region. The spectra are significantly 
affected by stray light in the region 3465 A - 3495 A, which is ex- 
cluded in the velocity dispersion fitting. 

The Sun gives very similar results as the other template stars. 
We conclude that determining velocity dispersions from the 
near-UV lines using the solar spectrum as a template may in- 
troduce systematic errors of ~ 5 %. Assuming the systematic 
errors can be added quadratically, we find a total systematic un- 
certainty of ~ 7 %. 

TABLE 2 



Velocity Dispersions of Nearby Galaxies 



Galaxy 


Template 


<y (Mgi,) 


a (3600) 


NGC 3610 


HD 102494 


143 ±2 


134±6 


NGC 3610 


HD 132737 


143 ±2 


134 ±5 


NGC 3610 


HD 210220 


143 ±2 


134 ±5 


NGC 3610 


Sun 


144 ±2 


135 ±6 


NGC 5018 


HD 102494 


206 ±3 


199± 15 


NGC 5018 


HD 132747 


207 ±3 


197 ±15 


NGC 5018 


HD 210220 


206 ±3 


199± 15 


NGC 5018 


Sun 


206 ±3 


194 ±15 



3. PHOTOMETRY 



Colors and structural parameters were determined from HST 
imaging previously described in van Dokkum et al. (2001b). 
The cluster was observed in the If%\aw band with the Wide Field 
and Planetary Camera 2 (WFPC2), and in the H F \ b o W band 
with the Near Infra-Red Camera and Multi-Object Spectrom- 
eter (NICMOS) NIC3 camera. We refer to van Dokkum et al. 
(2001b) for details of the observations and reduction. Figure 
4 shows a color image of RDCS J0848+4453 created from our 
HST imaging. The pixel scale of our final drizzled images is 

0. "04; the total area covered by both WFPC2 and NICMOS is 
2.3 arcmin 2 . 

3.1. Colors 

Colors were measured from the H F \aw and Ifzuw images in 

1. "5 diameter apertures, after smoothing the Ifuaw images to 



the NICMOS resolution. Zeropoints on the Vega system were 
obtained from the Data Handbooks (STScI, Baltimore) of NIC- 
MOS and WFPC2 respectively: 

H Fmw = -2.5 log(ADU/j) +21.496 (1) 
Ifsuw = -2.5 log(ADUA) + 21 .688. (2) 

A correction of 0.05 magnitudes was applied to the If&\4w ze- 
ropoint to account for the long/short anomaly (see, e.g., Wiggs 
et al. 1998). Galactic extinction is very small in this field 
(E(B-V) w 0.02; Schlegel, Finkbeiner, & Davis 1998) and 
was ignored. Measured colors are listed in Table 3. Errors are 
estimated at 0.07, dominated by systematic uncertainties in the 
zeropoints. 



TABLE 3 
Photometry 



Galaxy 


K s 


hi4 


hn — H\(,o 


logr e 


Me, 160 




Total 


r < 0'.'75 


r < 0"75 


II 




J0848-1 


17.36 


22.90 


3.48 


-0.010 


21.75 


J0848-2 


17.97 


22.94 


3.35 


-0.460 


20.19 


J0848-3 


18.71 


22.85 


3.10 


-0.880 


18.49 



3.2. Structural Parameters 

Following the procedures outlined in van Dokkum & Franx 
(1996) effective radii and effective surface brightnesses were 
determined for the three galaxies with measured velocity dis- 
persions. For each galaxy, models consisting of an r 1 / 4 law 
convolved with a Point Spread Function (PSF) were fitted di- 
rectly to the two-dimensional images. The NICMOS H F mw 
images were used in the fits, because the galaxies have much 
higher S/N than in the WFPC2 If&uw images. Furthermore 
effects of color gradients are minimized by fitting in the rest- 
frame 7?-band rather than the rest-frame f/-band. 

A separate PSF was used for each galaxy. The PSFs were 
created by applying the same dither pattern as used in the ob- 
servations to model PSFs generated by Tiny Tim (Krist 1995). 
The PSFs were then combined and rebinned using "drizzle" 
(Fruchter & Hook 1997), in the same way as the observations. 
We note that our results are not very sensitive to errors in the 
PSFs or color gradients, because the error in the product r e I® S3 
is almost parallel to the FP (see, e.g., J0rgensen, Franx, & 
Kjsergaard 1995a). Results from the fits are listed in Table 3. 
Effective radii are in arcseconds; surface brightnesses are in 
Hfi60w mag/arcsec 2 and not corrected for (1 ±z) 4 cosmologi- 
cal dimming. 

For a meaningful comparison between galaxies at different 
redshifts, measured surface brightnesses need to be converted 
to a common rest-frame band. We assume that the flux den- 
sity in the rest-frame B band can be related to the flux density 
in the observed If&uw and H F \mw bands by F B i z \ = Ff^F^~ a 
(see van Dokkum & Franx 1996). Using spectral energy dis- 
tributions from Coleman, Wu, & Weedman (1980) we find for 
z = 1.27 

B z = Hpiww ±0.50(7/? 8i4iv — Hfmw) ±1-81 (3) 

and, similarly, 

R z = H F i6ow ±0.02 (7/rgi 4 W — 77 f i6oiv) ± 1-95, (4) 

with the subscript z denoting rest-frame (i.e., redshifted) band. 
These transformations are very different from a traditional K- 
correction, as they use the observed colors of the galaxies to 
interpolate between passbands. As a result, they are indepen- 
dent of spectral type to ~ 0.03 mag. The total systematic error 
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J0848-1 



J0848-2 



J0848-3 






Fig. 4.— Color rendition of the core of RDCS J0848+4453 atz= 1.27, created from a WFPC2fr8i4H' image and a mosaic of three HSTmCMOS 
Hfimw images. The WFPC2 data were smoothed and resampled to match the resolution of the NICMOS data. Most of the objects appearing 
orange are cluster members. The insets show the three early-type galaxies with measured velocity dispersions. The scale of the large image is 
2^23 x 2^23, and of the insets 10" x 10". 
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Fig. 5. — Edge-on projection of the Fundamental Plane of the nearby Coma cluster (J0rgensen et al. 1996) in the B and R bands (open symbols). 
Solid symbols show the three early-type galaxies at z = 1.27. Surface brightnesses were corrected for (1 +z) 4 cosmological dimming, and trans- 
formed to the rest-frame B and R bands; log/ c = — 0.4fj, e . The z = 1.27 galaxies are offset with respect to the FP of Coma due to passive evolution 
of the stellar populations. The offsets are larger in the rest-frame B band than in the rest-frame R band. In both bands the offset is greatest for the 
"E+A" galaxy J0848-3. More data are needed to determine the form of the FP at z — 1.27. 



is estimated at ~ 0.05, which includes uncertainties in abso- 
lute spectrophotometry (see, e.g., van Dokkum & Franx 1996). 
Note that the redshifted Cousins R filter is a close match to the 
observed H F k,qw filter. 

As a test on our entire procedure we also determined struc- 
tural parameters from the WFPC2 If&uw images, using Tiny 
Tim PSFs and Eq. 3 to convert surface brightnesses to the B z 
band. We find that the difference in the parameter r e I® &3 is 5 % 
for J0848-1, 8 % for J0848-2, and 16 % for J0848-3. Given the 
much higher S/N in the NICMOS images these results can be 
viewed as upper limits to the true uncertainties. We conclude 
that the uncertainties in the M/L ratios of individual galaxies 
are dominated by random errors in the velocity dispersions. 

4. FUNDAMENTAL PLANE AND MASS-TO-LIGHT RATIOS 

The velocity dispersions and structural parameters allow us 
to study the Fundamental Plane of early-type galaxies at z = 
1.27. The Fundamental Plane of nearby clusters has the form 

r e oc <r a /f (5) 

with I e surface brightness at the effective radius in linear units. 
J0rgensen, Franx, & Kjsergaard (1996) find a = 1.20, (3 = 
-0.83 in the B-band and a = 1.23, f3 = -0.83 in Gunn r from 
an analysis of 225 early-type galaxies in ten nearby clusters. 
Assuming that early-type galaxies form a homologous family, 
the observed tilt of the FP implies that the M/L ratios of galax- 
ies scale with their mass as 

M/LocM a2 V°' 07 (6) 

in the B band. Therefore, the evolution of the Fundamental 
Plane tracks the evolution of the M/L ratios of galaxies (Franx 
1995). 



4. 1 . Edge-on Projection of the Fundamental Plane 

In Fig. 5 open symbols show the edge-on projection of the 
FP of the nearby Coma cluster (J0rgensen et al. 1996), and 
solid symbols show the three galaxies in RDCS J0848+4453 
at z = 1.27. The J0rgensen et al. Gunn r data were trans- 
formed to Cousins R using R — r = 0.35 (Fukugita, Shimasaku, 
& Ichikawa 1995). Surface brightnesses were corrected for 
(1 +z) 4 cosmological dimming. All three galaxies show a large 
offset from the FP of Coma, and we conclude that the galaxies 
at z = 1 -27 do not occupy the same Fundamental Plane as Coma 
galaxies. The offsets are smaller in the R z band than in the B z 
band, consistent with the expectation that early-type galaxies 
at z — 1-27 are bluer than those in Coma. Galaxies J0848-1 
and J0848-2 show a much smaller offset than the E+A galaxy 
J0848-3. 

Our sample of three galaxies is obviously too small to deter- 
mine the coefficients a and /3. The tilt of the FP may evolve 
with time due to various processes, such as systematic age dif- 
ferences between low mass galaxies and high mass galaxies. 
A study of 30 early-type galaxies in the cluster CL 1358+62 at 
z = 0.33 has shown that the form of the FP has not changed 
significantly over the past ~ 4Gyr (Kelson et al. 2000b). At 
higher redshift the samples are still too small to place strong 
constraints on the tilt. In the following, we do not strictly as- 
sume that the form of the FP at z = 1 .27 is the same as in nearby 
clusters, but we do assume that offsets from the Coma FP are 
due to changes in M/L ratio resulting from stellar evolution. 
This interpretation is supported by the fact that the E+A galaxy 
shows the largest deviation, and it is consistent with the reduced 
offsets in R z compared to B z . 
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Fig. 6. — Evolution of the M/L ratio of early-type cluster galaxies, in the rest-frame B band. In (a) individual galaxies in clusters at 
0.02 < z < 1-27 are shown. Data at z < 1 are taken from J0rgensen et al. 1996, van Dokkum et al. (1998) and Kelson et al. (2000). Open 
symbols are galaxies with masses M < 1O U M0. In (b) the data for each cluster are averaged, excluding galaxies with masses M < lO n M0. 
Broken lines are predictions from simple single burst stellar population synthesis models, with Zf orm = 6, 3, and 2. The solid line is a prediction 
from models incorporating morphological evolution, taken from van Dokkum & Franx (2001). The M/L ratios of the two most massive galaxies 
in RDCS J0848+4453 are consistent with an extrapolation of results obtained at z < 1. 
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Fig. 7. — Rest-frame B band mass-to-light ratio versus mass, for 
galaxies in Coma (open circles) and RDCS J0848+4453 (solid cir- 
cles). Galaxy J0848-3, the galaxy with the largest offset from Coma 
(i.e., the youngest stellar population), is a factor ~ 10 less massive 
than J0848-1 and J0848-2. 

4.2. Evolution of Mass-to-Light Ratios 

The evolution of the mean M/L ratio can be determined di- 
rectly from the evolution of the zeropoint of the FP (see Eq. 
6 and van Dokkum & Franx 1996). Similarly, for a single 



galaxy the offset from the Coma FP can be expressed as an 
offset in M/L ratio. Offsets for individual galaxies in clus- 
ters at 0.02 < z < 1.27 are shown in Fig. 6(a). The offsets 
in InM/Lg for galaxies J0848-1 and J0848-2 are -1.37 ±0.15 
and —1.27 ±0.14 respectively, remarkably consistent with an 
extrapolation of results obtained at 0.02 <z< 0.83. The offset 
of J0848-3 is much larger at AlnM/L B = -2.58 ±0.17, corre- 
sponding to a factor w 13. 

In Fig. 7 we investigate the M/L ratios of galaxies in 
RDCS J0848+4453 in more detail by showing the projection 
of the FP on the M/L ratio vs. mass plane. These quantities are 
defined in a straightforward way: 

logM = 21ogcr + logr e + Ci (7) 

and 

log M/Lfl = 21ogCT - log/, - logr e + C 2 . (8) 

With log/ e = -0.4(^,8 - 27.0), r e in kpc, C x = 6.07 and 
C2 = —1.29, mass and M/L ratio are expressed in solar units 
(see J0rgensen et al. 1996). 

The mass of galaxy J0848-3 is a factor ~ 10 lower than that 
of J0848-1 and J0848-2, and similar to the lowest mass galaxies 
in the J0rgensen et al. (1996) Coma sample. We conclude that 
its inclusion in our small sample is probably due to its high sur- 
face brightness and low M/L ratio, and it is unlikely (although 
not impossible) that this object is representative for galaxies in 
the mass range 10 < logM < 1 1. 

In Fig. 6 (b) we show the evolution of the mean M/L ratio 
of high mass galaxies, by selecting objects with M > 1O U M 
in all clusters (solid symbols in Fig. 6a). Note that this is not 
a true mass selected sample, since we may miss "underlumi- 
nous" galaxies with very high M/L ratios. The evolution is 
remarkably uniform and linear over the entire redshift range 
0.02 < z < 1 .27. A linear fit gives \nM/L B oc (- 1 .06 ± 0.09)z, 
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with the error dominated by systematic uncertainties. The rms 
scatter around the best fitting relation is only 0.03, significantly 
smaller than expected from the uncertainties in the individual 
datapoints. This may partly be caused by the cancellation of 
systematic errors, but can also be the result of small number 
statistics. This is almost certainly true for RDCS J0848+4453 
itself, because the random errors in the velocity dispersions 
alone already introduce an uncertainty of ~ 13% in the aver- 
age offset of J0848-1 and J0848-2. 

4.3. Implications for Luminosity Weighted Ages 

The evolution of the mean M/L ratio depends on the slope 
of the Initial Mass Function (IMF), the metallicity, cosmolog- 
ical parameters, and the luminosity weighted age of the stellar 
population (see, e.g., Tinsley & Gunn 1976; Worthey 1994). 
Furthermore, the observed evolution needs to be corrected for 
the effects of morphological evolution (van Dokkum & Franx 
2001). The cited studies provide a comprehensive discussion 
of these issues, beyond the scope of the present paper. Here we 
only consider two models: a simple model with a fixed IMF, 
varying age, and no morphological evolution, and the best fit- 
ting complex model from van Dokkum & Franx (2001). 

4.3.1. Simple Models 

In Fig. 6(b) the dotted lines show predictions of simple mod- 
els with a Salpeter (1955) IMF, Solar metallicity, and a range of 
formation redshifts. The models are of the form L oc (f — ff or m) K , 
with k determined from stellar population synthesis models 
(see van Dokkum et al. 1998, and references therein). The for- 
mal best fitting formation redshift is z* = 2. 6^4, correspond- 
ing to a luminosity weighted age of ~ 2 Gyr at the epoch of ob- 
servation. Note that these results do not apply to the low mass 
galaxy J0848-3, which has a much lower luminosity weighted 
age of ~ 0.5 Gyr. This age is qualitatively consistent with the 
presence of strong Balmer absorption lines in its spectrum. 

The new data reinforce earlier studies at lower redshift. In- 
terestingly the formal error in the formation redshift of the stars 
in massive galaxies suggests an upper limit of z* — 3.5 (la), 
whereas previous studies could only provide lower limits. How- 
ever, as discussed in van Dokkum et al. (1998) the inferred for- 
mation redshifts are strongly dependent on the assumed cos- 
mology and IMF. 

4.3.2. Complex Models 

The models discussed so far implicitly assume that early- 
type galaxies in high redshift clusters are typical progenitors 
of present-day early-type galaxies. However, there is good ev- 
idence that the set of early-type galaxies evolves with time. 
Dressier et al. (1997) and others (e.g., van Dokkum et al. 2001b; 
Lubin, Oke, & Postman 2002) have found a gradual decrease 
with redshift of the fraction of early-type galaxies in clusters, 
from ~ 80 % in low redshift clusters to ~ 45 % in clusters at 
z ~ 1, suggesting that ~ 50 % of early-type galaxies was trans- 
formed from other galaxy types in the last half of the age of the 
Universe. 

A consequence of such morphological evolution is that the 
sample of early-type galaxies at z = 1.3 is only a subset of 
the full sample of progenitors of present-day early-type galax- 
ies. Furthermore, the subset is biased, consisting of the oldest 
progenitors. As a result the observed evolution of early-type 
galaxies underestimates the true evolution that would be mea- 
sured if all progenitors had been accounted for. van Dokkum 



& Franx (2001) developed analytical models which take this 
"progenitor bias" into account. They can be used to correct 
the ages of early-type galaxies for the effects of morpholog- 
ical evolution. As shown in van Dokkum & Franx (2001) a 
model with progenitor bias can provide excellent simultaneous 
fits to the observed evolution of the mean M/L ratio, the early- 
type galaxy fraction, and the scatter in the color-magnitude re- 
lation at 0.02 < z < 0.83. Their best fitting model is shown 
by the solid line in Fig. 6(b). In this model the mean luminosity 
weighted formation redshift of the stars in all present-day early- 
type galaxies (z*) = 2.0+q \, whereas the formation redshift of 
the stars in the subset of early-type galaxies that were already 
assembled at z — 1 .27 is higher, at (z*) w 2.5. As can be seen in 
Fig. 6(b) the fit is equally good as simple models with z* ~ 3. 

In summary, the M/L ratios of the two galaxies with masses 
> 10 n M Q are well fitted by extrapolations of models fitted to 
data at z < 1 . Good fits are obtained for simple models that ig- 
nore selection effects and also for self-consistent models which 
incorporate morphological evolution. 



5. CORRECTING FOR LUMINOSITY EVOLUTION AT Z « 1.3 

The observed evolution of the M/L ratio can be used directly 
to correct the luminosities of distant galaxies for passive evo- 
lution, and convert luminosity to mass. Ultimately measure- 
ments of M/L ratios at high redshift should remove the need 
for stellar population synthesis models to interpret the evolu- 
tion of the luminosity function, and provide a direct measure- 
ment of the evolution of the galaxy mass function. The loga- 
rithmic correction we derive from massive cluster galaxies at 
0.02 < z < 1.27 corresponds to a brightening of 1.50 ±0.13 
magnitudes at z = 1.3. In absolute terms, a typical early-type 
galaxy with M/L B = 5.9h 5 o in units of (M/L b )q in the local 
Universe (van der Marel 1991) has M/L B = 1.5 ±0.2/z 50 at 
z=1.3. 

Massive early-type galaxies are expected to be a minor con- 
tributor to /f-selected samples of high redshift galaxies (e.g., 
Cimatti et al. 2002), but they may form a large fraction of 
the population of Extremely Red Objects. In Fig. 8 the dis- 
tance from the Coma Fundamental Plane, expressed in R z mag- 
nitudes, is plotted against / — H color. Interestingly, despite 
the low M/L ratio of J0848-3 all three galaxies have I-H>3 
(and also R — K>5) and fall in the class of Extremely Red Ob- 
jects. As discussed in § 4.3 simple models with Zf orm w 3 can 
be used to correct galaxies J0848-1 and J0848-2 for luminosity 
evolution, but such models severely underpredict the required 
correction for J0848-3. Since EROs are usually not selected by 
mass but on the basis of /f-band luminosity, ERO samples can- 
not be pruned by applying a mass cut (as we did in § 4.2 for 
galaxies with measured kinematics). Therefore, we conclude 
from our small sample that it is hazardous to use simple "Pas- 
sive Luminosity Evolution" (PLE) models (e.g., Pozzetti et al. 
1996) to correct EROs for luminosity evolution. Our results 
show that the correction can range from 1 — 2.5 magnitudes in 
the H-band at z « 1 .3, even in a restricted sample of luminous 
EROs with early-type morphology. We note that it may be pos- 
sible to improve the reliability of the correction by including a 
color term (for galaxies of known redshift); as demonstrated in 
Fig. 8 the observed correlation between AH and I — H color is 
similar to the expected correlation from stellar population syn- 
thesis models. 



van Dokkum & Stanford 



11 



-1 



en 
o 

£ -1.5 



or" -2 
< 



-2.5 



I 1 


1 1 1 

-, — Q 


1 1 1 


1 i i i 


form z. 

"7 R 






form 














J0848-2 






Z form ^ 






J0848- 1 " 


_ 










_ 


Z rorm ^ 


>• 




! 












1 


J0848-3 

1 


i i i 


1 




3 


3.2 


3.4 





F814W ''F160W 

Fig. 8. — Correction for luminosity evolution in rest-frame R (ap- 
proximately observed H ) for the three early-type galaxies at z — 1.27. 
All three galaxies have / — H > 3, and fall in the class of "Extremely 
Red Objects". Predicted corrections for different formation redshifts 
of the stars are indicated by dotted lines. The dashed line indicates 
the expected relation between rest-frame U — R color and R magni- 
tude for a Salpeter (1955) IMF, solar metallicity, and varying age. 
Simple "PLE" models with z form « 3 accurately predict the observed 
luminosity evolution for two galaxies, but underpredict the luminosity 
evolution of J0848-3 by more than a magnitude. 



6. CONCLUSIONS 

We have presented results on the Fundamental Plane of early- 
type galaxies in the cluster RDCS J0848+4453 at z = 1 .27. Al- 
though our sample of three galaxies cannot be used for a de- 
termination of the tilt and scatter in the FP, we can interpret 
the M/L ratios of individual galaxies by comparing them to 
the prediction of the FP in local clusters. The M/L ratios of 
the two most massive galaxies, when combined with those of 
massive galaxies in clusters at 0.02 < z < 0.83, are consistent 
with a very regular evolution of the mean M/L ratio of the form 
\nM/L B oc (-1.06±0.09)z. The third galaxy is a factor - 10 
less massive than the other two, and has a much lower M/L 
ratio. Our data are insufficient to determine whether the M/L 
ratio of this galaxy is typical for its mass. It is clear, however, 
that it is due to the presence of a young stellar population: the 
galaxy has an "E+A" spectrum, and its relatively blue color is 
consistent with its low M/L ratio. Unfortunately it will be diffi- 



cult to obtain much larger samples in a single cluster at z ~ 1.3, 
although it may be possible to combine results from different 
clusters to constrain the evolution of the FP better. 

The overall conclusion from our work on RDCS J0848+4453 
is that by z ~ 1 .3 we are approaching the epoch of formation of 
massive cluster galaxies. In van Dokkum et al. (2001b) we 
have shown that the most luminous galaxies show signs of in- 
teractions, with the second brightest cluster galaxy (a merger 
of three red ~ L* galaxies) the most spectacular example. Fur- 
thermore, we presented evidence that the slope of the color- 
magnitude relation may be flatter than in low redshift clusters. 
The present paper shows that the spectra of three of the most 
luminous early-type galaxies indicate the presence of a young 
stellar population in one galaxy, and possibly residual ongoing 
star formation in the other two. Furthermore, their M/L ratios 
indicate luminosity weighted ages of only 0.5 - 2Gyr at the 
epoch of observation. 

As discussed in § 5 the measurements presented here are rele- 
vant in a broader context than the evolution of galaxies in clus- 
ters, as they can be used to correct the luminosities of distant 
red galaxies for passive evolution of their stellar populations. 
Ultimately measurements of the Fundamental Plane and Tully- 
Fisher relation at high redshift, when combined with measure- 
ments of the luminosity function, should lead to an empirical 
determination of the evolution of the mass function. The sparse 
observations that are available now are already valuable, since 
they can be used to calibrate stellar population synthesis mod- 
els and provide realistic errors estimates. Apart from collecting 
larger samples in high redshift clusters, an obvious next step 
is to obtain similar data on field galaxies to determine whether 
there is an environmental dependence. 
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